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ABSTRACT 

A project was devised to develop study materials for 
a computer-assisted instruction (CAI) course in police training, to 
develop computerized case problems, and to evaluate the effectiveness 
of the learning materials as compared with conventional classroom 
instruction in the same subject areas. Both an experimental group 
(police cadets at Golden West Police Academy who studied the course 
materials through use of a syllabus and CAI) and a control group 
(police cadets at Los Angeles Police Academy who studied the same 
subject through conventional classroom instruction) took intelligence 
tests and personnel tests; results of these tests allowed 23 matched 
pairs from control and experimental groups to be formed. At the 
conclusion of the training program, all subjects completed a written 
examination. Results of analyses of performance scores on the 
examination showed that the experimental group performed 
significantly better than the control group. Apparently, then, CAI 
and independent study are effective techniques for police training 
and should be investigated further and expanded. (SH) 
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PREFACE 



This report describes the activities of Project CALCOP a joint 
project of the Coast Community College District, the Los Angeles 
Police Department, and the Los Angeles Police Academy. The proj- 
ect was financed in part by a grant from the Law Enforcement 
Assistance Administration (Institute Grant NI-066), and this paper 
serves as the final report of the project. 

A number of individuals deserve recognition for their efforts in 
doing the work of the project: 

Mr. Deraid D. Hunt, Director of Law Enforcement Program for Golden West 
College, for designing and preparing the Study Syllabus and the computer 
simulated case problems and for scoring the final examinations. 

Sergeant M. R. Ingalls, of the Los Angeles Police Academy, for designing 
and testing the final examination and for reviewing the Syllabus and other 
training materials. 

Mr. Monty Ruth, of the Coast Community College District, for preparing 
and implementing computer programs used in the simulation exercises 
and in the statistical analysis. 

Sergeant Diane Harber, of the Los Angeles Police Department, for coordinat- 
ing the otherwise diverse efforts of the Los Angeles Police Academy and 
the Coast Community College District. 

Miss Bonnie Borawski and Mrs. Ellen Gradick, of the Coast Community 
College District, for their efforts in assuring that the study materials and 
this report were properly produced. 

I list here others whose help represent important contributions to 
the success of this project: Lieutenant Delbert R. Wheaton, of the 
Los Angeles Police Department; Officer Ray Heslop, of the Los 
Angeles Police Department; Mr. George Martin, of the Los Angeles 
Police Department; Mr. Thomas Adams, Coordinator of the Police 
Science Program at Santa Ana College; and Officer Roger Sobie, of 
the Los Angeles Police Department. 
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/. SUMMARY 



Coast Community College District and the Los Angeles Police 
Department have completed a joint project for the development, 
implementation and evaluation of computer assisted instruction tech- 
niques in a specific area of police training. 

Recent months have seen considerable excitement concerning com- 
puter assisted learning as a new instructional technique. By and large, 
computer assisted learning, or as it is often called, computer assisted 
instruction (CAI), is defined as a process in which a student interacts 
more or less directly with a computer system in a learning situation. 



Purpose 

Project CALCOP served a two-fold purpose. First, the project 
sought to develop a computer assisted learning system for the purpose 
of training in the area of search and seizure and rules of evidence. 
Second, the project evaluated the effectiveness of the computer 
assisted learning system. In doing this, the project examined the 
hypothesis that the learning system designed by the project, consist- 
ing of independent study and CAI exercises, would be more effective 
than conventional classroom instruction. 



Procedures 

Procedures followed in Project CALCOP, are enumerated below: 

1. Objectives of training programs in search and seizure and 
rules of evidence were formulated. 

2. An examination designed to test the degree to which the 
objectives were met was developed. 

3. A syllabus of cognant material to be used for study purposes 
on an independent basis was prepared. 

4. Case problems simulated through the use of the computer 
terminal were prepared and implemented. 

1 
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5. Training was conducted using the computer assisted learning j 

system and the syllabus at Golden West College. Training 

also took place through conventional classroom instruction j 

at the Los Angeles Police Academy. 

6. The examination was administered to police cadets at both i 

the Los Angeles Police Academy and the Golden West Acad- ! 

emy. Performance on this examination was compared between j 

the two groups to determine if the computer assisted instruc- j 

tion techniques were more or less effective than conventional ) 

classroom techniques. j 

J 




Results 1 




Comparison of examination performance levels on the part of the j 

Los Angeles Police Academy cadets and the cadets at Golden West j 

College Police Academy showed that the Golden West College group j 

performed significantly better on each of the three parts of the exami- j 

nation as well as for the examination as a whole. The difference in i 

performance levels was found to be statistically significant in each \ 

case at the .01 level of confidence. -j 
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Conclusions j 

4 




Learning systems such as that developed .by Project CALCOP \ 

which remove the police cadet from the rigid discipline of the acad- j 

emy classroom show significant promise as more effective pedagogical 1 

techniques than current methods. k 
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//. PROCEDURES 



Project CALCOP engaged in a number of activities during its 
execution. These include establishment of behavioral objectives to 
be achieved by police cadets using the learning materials developed; 
establishing a steering committee for the project; establishing an 
executive committee for the project; preparing the simulation mate- 
rials; and designing, testing and executing evaluation methods. Each 
of these activities is discussed in the paragraphs to follow. 



Establish Project Steering Committee 

As outlined in the project proposal of April 10, 1969, Project 
CALCOP operated under the guidance of a steering committee com- 
posed of police officials, educational experts, and lay police advisors. 
Individuals serving on the Project CALCOP steering committee are 
listed below. 

Inspector George Beck, Assistant Commander, Office of Special 
Services, Los Angeles Police Department, Chairman. 

Dr. Norman E. Watson, Chancellor, Coast Community College 
District. 

Deputy Chief Robert ' Gaunt, Commander, Planning and Fiscal 
Bureau, Los Angeles Police Department. 

Inspector Vernon Hoy, Assistant Commander, Personnel and 
Training Bureau, Los Angeles Police Department. 

Mr. Arthur Suchesk, Manager of Instructional Media and Systems, 
Southern California Regional Occupational Center. 

Mr. John S. Owens, Vice Chancellor, Vocational Education, Coast 
Community College District. 

Captain George Conroy, Commander, Records and Identification 
Division, Los Angeles Police Department. 

Mr. Deraid D. Hunt, Director of Law Enforcement Program, 
Golden West College Police Science Program. 
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Establish Project Executive Committee 



The Project Executive Committee oversaw the work done by the 
project, determined goals an,I objectives, and reviewed the final 
results. The Executive Committee consists of police officers and 
educators as listed below. 

Lieutenant Delbert R. Wheaton, Los Angeles Police Department. 

Sergeant Diane Harber, Los Angeles Police Department. 

Sergeant M. R. Ingalls, Los Angeles Police Department. 

Mr. Deraid Hunt, Director of Law Enforcement Program, Golden 
West College. 

Mr. Richard W. Brightman, Director of Research and Planning, 
Coast Community College District. 

; 

Establish General and Behavioral Objectives 

The initial Project CALCOP proposal outlined broad objectives 
to be served by the Project. The first task of the Executive Commit- 
tee, meeting during the summer of 1969, was to develop specific 
general and behavioral objectives of the program. These objectives 
are described in a later section of this report. 



Preparation of Study Syllabus 

A study syllabus was prepared outlining the factual or cognate 
material that Golden West police cadets should master before enter- 
ing the field as operating police officers. Preparation of this document 
involved the efforts of the Law Enforcement staff at Golden West 
College. The completed syllabus was thoroughly reviewed by the 
instructional staff at both Golden West College and the Los Angeles 
Police Academy. The review revealed several points in the syllabus 
that require, updating and revision because of recent court decisions 
regarding police procedures in arrest, search and seizure. A syllabus 
critique prepared by the Los Angeles Police Academy is available. 
Interested parties should address requests to: 

Richard W. Brightman 
Director of Research and Planning 
Coast Community College District 
1370 Adams Avenue 
Costa Mesa, California 92626 
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Preparation of Simulated Case Problems 
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Case problems simulated through the use of computer terminals 
were developed for twenty-six cases reported in the Law Enforcement 
Legal Information Bulletin published by the Los Angeles District 
Attorney’s office. Use of these case problems involved a two-fold 
process. First, police cadets would apprise themselves of the basic 
facts of a particular case situation. Once satisfied that they were 
familiar with it and with the laws surrounding the situation as pre- 
sented in the syllabus, they would approach a computer terminal, 
identify themselves and the particular case they wanted to work on. 
The computer terminal would respond by asking them questions 
about the case, providing them additional information, and evaluat- 
ing the results of their work. 

Appendix I includes all of the written descriptions of the twenty- 
six case problems as well as a list of all of the case problems identi- 
fied by number and by the APL workspace name in which the cases 
could be found in the Coast Community College District computer 
system. Computer programming for the simulated portions of the 
case problems was accomplished through the use of APL program- 
ming language. Complete program documentation of each of the 
case problems is available from the Coast Community College Dis- 
trict and interested parties should send requests to the address shown 
on the preceding page. 

Appendix II shows typical computer terminal output for the execu- 
tion of cases 12 and 22. For the purpose of illustrating the manner 
in which incorrect responses were treated by the computer, the 
operator answered questions incorrectly about as many times as he 
answered them correctly. 



Preparation of Evaluation Materials 

In considering techniques of evaluation, the Executive Committee 
recognized the need to approximate, as much as possible, actual field 
situations that prospective peace officers are likely to encounter while 
on duty. Ideally, each cadet should investigate a mock field situation 
prepared by the educational institution and would be evaluated in 
terms of his performance in conducting his investigation. Clearly, 
this ideal evaluation technique is impractical for most educational 
institutions, as it requires considerable amounts of time for each 
student being evaluated. A promising alternative, investigated by the 
Committee, involved depiction of one or more field situations through 
the use of photographic slides and/or video tape. Such presentation 
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could be made to an entire class at once with the students answering 
specific questions concerning the situation as a means of taking the 
examination. Our investigations showed that with the resources avail- 
able to Golden West College, production of photographic slides or 
video tapes for use as described above was impractical. 

As a more feasible alternative, a written final examination was 
prepared using the same conceptual logic as might be used in a video 
tape presentation. A specific situation was described, questions were 
asked of the student about the situation and the student’s responses 
were evaluated to determine a test score. The examination prepared 
was tested thoroughly at the Los Angeles Police Academy before it 
was implemented and administered to the control and experimental 
groups. This examination appears in Appendix III. 



Evaluation of Learning Materials 

The learning materials, consisting of the syllabus and the simulated 
case problems, were evaluated using established statistical and experi- 
mental techniques. These procedures are thoroughly described in 
Section IV of this report. 
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111. OBJECTIVES OF PROJECT CALCOP 



As reported in the Project CALCOP quarterly progress report of 
October 1, 1969, and as later refined, file general and behavioral 
objectives of the project are enumerated below. 



General Objectives 

1. Develop study materials in search and seizure to be used for 
recruit training in criminal investigation; 

2. Develop computerized case problems which stem from (1) 
above and which reinforce learning, broaden perspectives, and 
provide simulated field experiences for those completing the 
search and seizure section of recruit training; and to 

3. Evaluate the effectiveness of the learning materials developed • 
in (1) and (2) above as compared with conventional classroom 
instruction in the same subject areas. 

These general objectives serve the broader purposes of: 

1. Preparing officers for field police work. 

2. Preparing officers to apply basic rules of evidence to field 
situations involving criminal investigation. 



Behavioral Objectives 

After completing the segment of study prepared by Project CAL- 
COP, police officers and police cadets should be able to perform the 
following tasks: 

1. Recognize Evidence and Identify Types of Evidence 

Demonstration of the ability to perform this task will in- 
volve studying a field situation and selecting and identifying 
pertinent evidence related to the situation. Within ten minutes, 
students will correctly identify 80 percent of the pertinent 
items of evidence found in an actual situation as examined 



through the use of written case descriptions and/or audio- 
visual presentations. 

2. Gather and Preserve Evidence 

a. Prepare Reports and Field Notes Demonstration of the 
ability to do this will involve studying field situations and 
identifying evidence to be included in specific report types. 
Within fifteen minutes students will examine a field situa- 
tion and prepare reports required by the evidence on hand. 
The situation will be presented through the use of written 
case description and/or audio-visual presentation. 

b. Gather Testimony from Witnesses Demonstration of 
the ability to do this will involve identifying witnesses to 
a field situation who should be interviewed. Students will 
examine a field situation and within ten minutes must 
identify all witnesses who should be interviewed. The field 
situation will be presented through the use of written case 
descriptions and/or audio-visual presentation. 

c. Gather and Preserve Physical Evidence Demonstration 
of the ability to do this will involve identifying artifacts 
to be gathered from field situations as evidence and select- 
ing means to collect and preserve them. Students will 
examine a field situation and list 85 percent of the items 
that should be gathered as evidence and will associate 
these with written descriptions of the means best used to 
gather and preserve them. This will be accomplished in 
twenty minutes. The field situation will be presented with 
written case descriptions and/or audio-visual presenta- 
tion. 

3. Exercise Evidence-Gathering Techniques that Assure the 
Admissibility of the Evidence in Court 

Demonstration of the ability to perform, this task will in- 
volve: ^ 

a. Distinguishing evidence from non-evidence in field situa- 
tions. 

b. Identifying evidence as found in field situations that will 
be inadmissible in court as opposed to that which will not 
be admissible. 

The student will examine a field situation and list item:; of 
evidence as differentiated from non-evidence and will further 
categorize items of evidence into those that will be excluded 
as opposed from those that would not be excluded in a court 
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of law. Eighty-five percent of the items in the situation must' 
be correctly categorized within twenty minutes. The field 
situation will be presented using written case descriptions and/ 
or audio-visual presentation. 



Meeting the Objectives 

As originally articulated in the Project CALCOP proposal and 
in subsequent quarterly reports, the project’s objectives pointed to 
considerably more elaborate learning systems than were feasible for 
development with the resources available to the District. For example 
rather than preparing elaborate tutorial interactive materials for 
computer- assisted study of cognant material in the area of search and 
seizure, the project found it more feasible to develop the study 
syllabus. A syllabus was determined to be more flexible for student’s 
use inasmuch as it could be used and studied virtually anywhere 
without requiring the student to use a computer terminal. 

The specific behavioral objectives found in Section III of this 
report were particularly difficult to evaluate in terms of the time 
available for evaluation. There is little question that the syllabus and 
the simulated case problems as learning strategies contribute to the 
police cadet’s ability to recognize, identify, gather, and preserve 
evidence in a manner that assures admissibility of the evidence in 
court. Designing evaluation devices to measure the degree to which 
these objectives are served by the learning strategies is quite a difficult 
matter. The total amount of classroom time typically spent in the 
area of search and seizure seldom exceeds ten hours. Testing exer- 
cises sufficient to measure the behavioral objectives outlined in Sec- 
tion III of this report must necessarily he very comprehensive and 
very detailed in nature, involve considerable photographic represen- 
tation of case situations and probably would be best implemented 
through the use of a crime-site mock-up. Surrendering to the difficul- 
ties of preparing such evaluative instruments, we developed the exam- 
ination appearing in Appendix III as an approximation to the ideal 
expressed in the behavioral objectives. More about this important 
matter will be said in the conclusion of this report. 

Despite the difficulties in preparing an evaluative technique that 
meets the aspirations of the expressed behavioral objectives of the 
project, evidence presented in Section IV of this report leads us to 
believe that these instructional techniques are more effective in meet- 
ing the objectives of course work in search and seizure than in con- 
ventional classroom techniques. The examination that has been em- 

9 



14 



ployed does in fact present the police cadet with a case situation in 
which he must evaluate appropriate steps to take. His answers to the 
questions put to him by the examination are some indication of the 
degree to which he understands the appropriate procedures to use 
when actually in the field. 
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